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Abstract 

HIFOO is a public-domain Matlab package initially designed for fixed-order 
controller synthesis, using nonsmooth nonconvex optimization techniques. It was 
later on extended to multi-objective synthesis, including strong and simultaneous 
stabilization under constraints. In this paper we describe a further extension 
of HIFOO to H2 performance criteria, making it possible to address mixed H^jHoo 
synthesis. We give implementation details and report our extensive benchmark 
results. 
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1 Introduction 

HIFOO is a public-domain Matlab package originally conceived during a stay of Michael 
Overton at the Czech Technical University in Prague, Czech Republic, in the summer of 
2005. HIFOO relies upon HANSO, a general purpose implementation of an hybrid algo- 
rithm for nonsmooth optimization, mixing standard quasi-Newton (BFGS) and gradient 
sampling techniques. The acronym HIFOO (pronounce [haifu:]) stands for H-infinity 
Fixed-Order Optimization, and the package is aimed at designing a stabilizing linear 
controller of fixed-order for a linear plant in standard state-space configuration while 
minimizing the norm of the closed-loop transfer function. 

The first version of HIFOO was released and presented during the IFAC Symposium 
on Robust Control Design in Toulouse, France in the summer of 2006, see [5], based 
on the theoretical achievements reported in [5]. HIFOO was later on extended to cope 
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with multiple plant stabilization and multiple conflicting objectives and the second major 
release of HIFOO was announced during the IFAC Symposium on Robust Control Design 
in Haifa, Israel, in the summer of 2009, see [TJ. 

Since then HIFOO has been used by various scholars and engineers. Benefiting from feed- 
back from users, we feel that it is now timely to extend HIFOO to H 2 norm specifications. 
Indeed, H 2 optimal design, a generalization of the well-known linear quadratic regulator 
design, is traditionally used in modern control theory jointly with Hoo optimal design, see 
[TT] . In particular, the versatile framework of mixed #2/^00 design described e.g. in [9] 
is frequently used when designing high-performance control laws for example in aerospace 
systems, see [2J. See also [TO] for an application of the H 2 norm for smoothening 
optimization. 

The objective is this paper is to describe the extension of HIFOO to H 2 norm specifica- 
tions in such a way that users understand the basic mechanisms underlying the package, 
and may be able to implement their own extensions to fit their needs for their target 
applications. For example, the algorithms of HIFOO can also be extended to cope with 
discrete-time systems, pole placement specifications or time-delay systems. On the HI- 
FOO webpage 

www . cs . nyu . edu/ overton/ sof tware/hif 00 

we are maintaining a list of publications reporting such extensions and applications in 
engineering. The HIFOO and HANSO packages can also be downloaded there. 

2 Hi and Hijli^ synthesis 

2.1 H2 synthesis 

We use the standard state-space setup 

x = Ax + Biw + B 2 u 
z = C\x + D\\w + D12U 
y = C 2 x + D 21 w + D 22 u 

where x contains the states, u the physical (control) inputs, y the physical (measured) 
outputs, w the performance inputs and z the performance outputs. Without loss of 
generality, we assume that 

D 22 = 

otherwise we can use a linear change of variables on the system inputs and outputs, see 
e.g. HU. 

We want to design a controller with state-space representation 

x K = A K x K + B K y 
u = C K x K + D K y 
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so that the closed-loop system equations become 



x 

z 



A(k)x + B(k)w 
C(A;)x+D(A;)w 



in the extended state vector x 

A(k) 



[x T with matrices 



B(*) 

C{k) 
D(fc) 



A + B 2 D^C 2 B 2 Ck 
B K C 2 A K 

B\ + B 2 DkD 2 \ 
BrD 2 i 

[ d + D^D* tf 2 5 Xj D 21 ] 
D u + D l2 D K D 2l 

depending affinely on the vector k containing all parameters in the controller matrices. 

The H 2 norm of the closed-loop transfer function T(s) between input w and output z is 
finite only if matrix A is asymptotically stable and if D is zero (no direct feedthrough) . 
This enforces the following affine constraint on the controller matrix: 

D n + D 12 D K D 21 = 0. (1) 

We use the singular value decomposition to rewrite this affine constraint in an explicit 
parametric vector form, therefore reducing the number of parameters in controller vector 
k. If the above system of equations has no solution, then there is no controller achieving 
a finite H 2 norm. 

In order to use the quasi-Newton optimization algorithms of HANSO, we must provide 
a function evaluating the H 2 norm in closed- loop and its gradient, given controller pa- 
rameters. Formulas can already be found in the technical literature [8], but they are 
reproduced here for the reader's convenience. The (square of the) norm of the transfer 
function T(s) is given by 



f(k) = \\T(s)\\l = trace (CX(A;)C T ) = trace (B T Y(k)B) 
where matrices X(k) and Y(k) solve the Lyapunov equations 



A T (k)X(k) + X(k)A{k) + C T {k)C{k) 
A(k)Y(k) + A T (k)Y(k) + B(k)B T (k) 



0. 




(2) 



and hence depend rationally on K. The gradient of the H 2 norm with respect to controller 
parameters K is given by: 



V*/(fc) 



2(B T 2 X(k) + T) T l2 C(k))Y(k)C 2 
+2B 2 r X(fc)B(A;)D 2 r 1 



upon defining the augmented system matrices 



B 



" 


B 2 ' 







1 " 


1 





, c 2 = 








D 



12 



[0 D 



12J 



D 



21 





D 21 
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As an academic example for which the H 2 optimal controller can be computed analytically, 
consider the system 

x = —1 + w + u 





' 1 " 




" " 


z = 





X + 






1 



u 



y 



X 



with a static controller 



u = ky 

with k a real scalar to be found. Closed-loop system matrices are 



A = -1 + k, B = 1, C 



1 

k 



The first Lyapunov equation in ([2]) reads 

2(-l + k)X(k) + 1 + k 2 = 
so the square of the H 2 norm is equal to 

f(k) ~ 1 + e 

nk) ~ 2(1 -ky 

For the gradient computation, we have to solve the second Lyapunov equation in 

2(-l + k)Y(k) + 1 =0 

and hence 



V/(fc) 



1 + 2k - k 2 



2(1 - k) 2 

This gradient vanishes at two points, one of which violating the closed-loop stability 
condition — 1 + k < 0. The other point yields the optimal feedback gain 

k* = 1 - \[2 w -0.4142 

see Figured] 

Using HIFOO with the input sequence 

P=struct('A' ,-1, 'Bl' ,1, 'B2' ,1, . . . 
'CI' , [1;0] , 'C2' ,1,'Dll' , [0;0] , . . . 
'D12' , [0;1] , , D21 J ,0, 'D22' ,0) ; 
options . prtlevel=2 ; 
K=hifoo(P, 't' , options) 



we generate the 3 sequences of optimized H 2 norms displayed on Figure |2l yielding an 
optimal H 2 norm of 0.6436 consistent with the analytic global minimum a/ \/2 — 1. Note 
the use of the optional third input parameter specifying a verbose printing level. Note 
also that the sequences generated on your own computer may differ since random starting 
points are used. 
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Figure 1: H2 norm as a function of feedback gain. 




1 2 3 4 5 6 7 

iteration 



Figure 2: H 2 norm sequences optimized within HIFOO. 



2.2 Mixed # 2 /#oo synthesis 

One interesting feature of adding H 2 performance in the HIFOO package is the possibility 
to address the general mixed H 2 / Hoo synthesis problem depicted on Figure [3] where the 
open-loop plant is denoted by P and the controller is denoted by K. A minimal state-space 
realization of the plant is given by 



P{s) := 



A 


Boo 


B 2 


B 


Coo 


Doo 





Dcou 


c 2 










c 


Dyoo 










Figure 3: Standard feedback configuration for mixed H^/H^ synthesis. 



The optimization problem reads 



min K 11^2(5)112 

S.t. ||Poo(s)||oo < 7c 



where P 2 {s) is the transfer function between H 2 performance signals w 2 and z 2 , and P O0 (s) 
is the transfer function between Hoo signals Woo and z^: 







' A 


B 2 


B 






c 2 





D 2u 






C 













A 


Boo 


B 


Poo{s) 




Coo 


Doo 


Doou 






c 


-Dyoo 






(3) 



An academic example for which the global optimal solution has been calculated in [3] is 
used as an illustration for the mixed H 2 /Hoo synthesis problem. Data for the model are 
given by 



.4 



Co 



1 
-1 

1 




B 



Bo 




1 



c= [ 1 ] 



D 



2u 





1 



Coo = [ 1 ] B 
Doo = 



1 





Do 



Dyoo — Dy 2 — 0lx2- 

The analytical solution may be found by solving the following mathematical programming 
problem as in [3] 



min J{k) 

k 

S.t. 



k < 

/(*) < 7oo. 



(4) 
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For a non redundant mixed H 2 /H oc (1 < 7 M < — — ), the global optimal solution is 

V5 



k* = ~\/2 -2^1-1/72 

(5) 



\P2W2 = 



For 7 = 1.2, HIFOO gives the global optimal solution 

k* = -0.9458 

H-P2II2 = 1-5735 ||-P<x)||oo = 1-2 

with the input sequence 

P2=struct('A' , [0 1;-1 0] , 'Bl ' ,eye(2) , 'B2' , [0; 1] , . . . 
'Cl\[l 0;0 0], , C2',[0 1] , 'Dll' ,zeros(2,2), . . . 
'D12' , [0;1] , 'D21' , [0 0] , 'D22' ,0) ; 

Pinf = struct ('A' , [0 1;-1 0] , 'Bl ' , [1 ; 0] , . . . 
'B2\ [0;1] ,'C1\ [0 1],'C2',[0 1] , 'Dll' ,0, . . . 
'D12' ,0, 'D21' ,0, 'D22' ,0) ; 



K=hif 00 ({P2 , Pinf} , ' th ' , [Inf , 1 . 2] ) 



3 Implementation details 

3.1 Implementing H2 norm into HIFOO 

In the main HIFOO function hif oomain.m, we added an option 't' for H2 norm spec- 
ification, without affecting the existing features. Proceeding this way, the H 2 norm can 
enter the objective function or a performance constraint. The H 2 synthesis works in the 
same way as the synthesis, using a stabilization phase followed by an optimization 
phase. 

A typical call of HIFOO for H2 static output feedback design is as follows: 
K = hifooCACl' , 't') 

where AC1 refers to a problem of the COMPlib database, see [5J [7]. 

We added the function htwo.m computing the H 2 norm and its gradient, given the con- 
troller parameters. We had to pay special attention to the linear system of equations 
arising from constraint ([Q). When the user also specifies the controller structure, we have 
added this constraint to the existing H 2 constraints. To do this we had to change the way 
the controller structure was treated by HIFOO. 
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The above formulae for the computation of the H 2 norm and its gradient are given for 
D 22 = 0, i.e. zero feedthrough matrix. When this matrix is nonzero we can use the 
same functions for synthesis, with some precautions. By considering the shifted output 
y = y — D 22 u, we recover the initial case with zero feedthrough matrix. We compute the 
controller matrices Ak, Bk, Ck, Dr based on the shifted output and then we apply a 
transformation on the controller matrix. We obtain the final solution: 

A K = A K -B K D 22 (1 + D K D 22 )- 1 C K 

B K = B K {l-D 22 {l + b K D 22 )- l D K ) 

C K = (I + DkD^Ck 1 } 

D K = (I + DkD^Dk. 

Given the way this case is treated, multiple plant optimization only works if the plants 
have the same feedthrough matrix. Note however that the case of nonzero feedthrough 
matrix and imposed controller structure cannot be treated by the current version of the 
program but could be the object of further development. 

3.2 Numerical linear algebra 

For ifoo norm optimization, HIFOO calls Matlab's function eig to check stability, returns 
inf if unstable, and otherwise calls the Control System Toolbox function norm, which 
proceeds by bisection on successive computations of spectra of Hamiltonian matrices. 
This latter function relies heavily on system matrix scaling, on SLICOT routines, and its 
is regularly updated and improved by The MathWorks Inc. We observe experimentally 
that calling eig once before calling norm is negligible (less than 5%) in terms of total 
computational cost. 

For H 2 norm optimization, HIFOO calls eig to check stability, returns inf if unstable, 
and otherwise calls Matlab's lyap function to compute the norm and its gradient. Ex- 
perimentally, we observe that the time spent by eig to check stability is approximately 
20% of the time spent to solve the two Lyapunov functions. 

So a priori stability check is negligible for optimization and comparatively small but 
not negligible for H 2 optimization. In this latter case there is some room for improvement, 
but since the overall objective of the HIFOO project is not performance and speed but 
reliability, we decided to keep the stability check for H 2 optimization. 

4 Benchmarking 

4.1 H2 synthesis 

We have extensively benchmarked HIFOO on problem instances studied already in [I] 
with an LMI/randomized algorithm. Since random starting points are used in HIFOO we 
kept the best results over 10 attempts each with 3 starting points, with no computation 
time limit. We ran the algorithms only on systems which are not open-loop stable. For 
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comparison, we took the best results obtained in [1]. In Tabled], we use the following 
notations: 

*: linear system ([I]) has a unique solution which is not stabilizing 

• : linear system ([T]) has no solution 

+ : algorithm initialized with a stabilizing controller 

f: no stabilizing controller was found 

r: rank assumptions on problem data are violated. 

Also n x , n u , n y denote the number of states, inputs and outputs. In addition to H 2 norms 
obtained by the LMI algorithm and HIFOO, we also report for information the H 2 norm 
achievable by full-order controller design with HIFOO. Numerical values are reported to 
three significant digits for space reasons. 

In some cases (e.g. IH and CSE2) we observe that the norms achieved with a full-order 
controller are greater than the norms achieved with a static output feedback controller. 
This is due to the difficulty of finding a good initial point in the full-order case. A more 
practical approach, not pursued here, consists in gradually increasing the order of the 
controller, using the lower order controller found at the previous step. 

For the considered examples, HIFOO generally gives better results than the random- 
ized/LMI method of [3]. We also report the performance achievable with a full-order 
controller designed with HIFOO. We could not use the H 2 optimal synthesis functions of 
the Control System Toolbox for Matlab as the technical assumptions (rank conditions on 
systems data) under which these functions are guaranteed to work are most of the time 
violated. 

4.2 H2 synthesis for larger order systems 

For larger order systems, we compared our results with those of p] which are also based on 
nonsmooth optimization (labeled NSO). In Table [2] the column indicates the order of 
the designed controller. We observe that HIFOO yields better results, except for example 
CM4 in the static output feedback case. 

4.3 Mixed H^jH^ synthesis 

In this section we compare the results achieved with HIFOO with those of pQ in the case 
of the mixed H 2 / synthesis problem, depicted on Figure El 

In Table [3] is the order of the controller and 7^ is the level of performance (a 
constraint). For problem dimensions refer to Table |2J 

We observe that HIFOO returns better or similar results than the non-smooth optimiza- 
tion (NSO) method of [1], except for problem CM4 in the static output feedback case. 
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Based on the CPU times of the NSO method gracefully provided to us by Aude Ron- 
depierre (not reported here), we must however mention that HIFOO is typically much 
slower. This is not surprising however since HIFOO is Matlab interpreted, contrary to 
the NSO method which is compiled. 

5 Conclusion 

This paper documents the extension of HIFOO to H 2 performance. The resulting new 
version 3.0 of HIFOO has been extensively benchmarked on H2 and minimization 
problems. We illustrated that HIFOO gives better results than alternative methods for 
most of the considered benchmark problems. 

HIFOO is an open-source public-domain software that can be downloaded at 

www. cs .nyu. edu/overton/sof tware/hif 00 

Feedback from users is welcome and significantly helps us improve the software and our 
understanding of nonsmooth nonconvex optimization methods applied to systems control. 

Just before the completion of this work, Pierre Apkarian informed us that several al- 
gorithms of nonsmooth optimization have now been implemented by The MathWorks 
Inc. and will be released in the next version of the Robust Control Toolbox for Matlab. 
Extensive comparison with HIFOO will therefore be an interesting further research topic. 
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Table 1: H 2 norm achieved for SOF controller design with L MI /randomized methods and 
HIFOO, and full-order controller design with HIFOO. 
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Table 2: H 2 norm achieved with HIFOO compared with the nonsmooth optimization 
method of pp. 
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Table 3: Mixed H-ijH^ design with HIFOO compared with the nonsmooth optimization 
method of [I]. 
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0.804 


0.908 


1.06 




10 


10 


0.608 


0.765 


0.867 


1.11 







0.8 


0.919 


0.791 


0.943 


0.800 




10 


0.8 


1.16 


0.772 


1.23 


0.800 




41 


0.8 


1.24 


0.789 


2.32 


0.800 


HFl 





10 


0.0582 


0.0582 


0.460 


0.461 







0.45 


0.0588 


0.0588 


0.450 


0.450 




10 


0.45 


0.0586 


0.0587 


0.450 


0.450 




25 


0.45 


0.0586 


0.0587 


0.450 


0.450 


CM4 





10 


0.927 


0.927 


1.66 


1.66 







1 


0.986 


0.984 


1.00 


1.00 




25 


1 


1.25 


0.953 


10.4 


1.00 
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